Mental Health Provider Reach and Engagement in a Countywide Training Initiative.

Many training initiatives are underway to increase implementation of evidence-based practice (EBPs) in mental healthcare. However, little is known about what types of trainings and supports yield the highest reach and engagement. Supported by a tax-funded, countywide initiative to improve access to quality care for youths, the current mixed methods study evaluates mental health (MH) provider reach, or registering for the training initiative, and engagement, or participation in training activities, for several EBP training and implementation supports. MH providers were offered free 1) formal EBP workshops, 2) a biweekly learning community, 3) individual case consultation, and 4) confidential online clinical feedback system. To register, interested providers (N = 698) completed a web-based assessment measuring clinical practice information, organizational implementation climate, and EBP knowledge, attitudes, and practices. Thirteen providers, selected via purposeful sampling stratified by level of participation, completed semi-structured qualitative interviews. While the training initiative achieved high reach (66% of county agencies had a provider register), far fewer providers engaged substantially in training. Quantitative results indicated that providers whose professional discipline was not psychology, had higher baseline EBP knowledge, more extensive use of common evidence-based strategies, and less extensive use of other therapy strategies, engaged in more training. Rapid qualitative analysis of interviews expanded upon these findings and illuminated provider, organizational, system, practical, and training activity-specific barriers and facilitators to engagement. Findings suggest the importance of identifying strategies for improving provider engagement in training activities beyond workshops. Implications for future research and training initiatives are discussed.

Principle-Guided Psychotherapy for Children and Adolescents (FIRST): study protocol for a randomized controlled effectiveness trial in outpatient clinics.

BACKGROUND: Hundreds of youth psychotherapy randomized trials have generated scores of helpful empirically supported treatments (ESTs). However, the standardized structure of many ESTs and their focus on a single disorder or homogeneous cluster of problems may not be ideal for clinically referred youths who have comorbidity and whose treatment needs may shift from week to week. This concern has prompted development of flexible transdiagnostic, modular youth psychotherapies. One of these, designed for efficient training and implementation, is FIRST-a transdiagnostic intervention built on five empirically supported principles of change (i.e., feeling calm, increasing motivation, repairing thoughts, solving problems, and trying the opposite) and targeting common internalizing and externalizing youth mental health disorders and problems. FIRST has shown promise in improving youth mental health in three open trials. Now, in a more rigorous test, we seek to (1) conduct a randomized controlled trial comparing FIRST to usual care in real-world clinical practice settings; (2) examine a promising candidate mediator of change-regulation of negative emotions; and (3) explore variables that may influence clinicians' treatment implementation. METHODS: This is an assessor-naïve randomized controlled effectiveness trial in youth outpatient community clinics in New England and Texas. Using double randomization, clinic-employed clinicians and treatment-referred youths (7-15 years old) are independently randomly allocated (1:1) to FIRST or usual care. We aim to recruit 212 youth participants, all referred through normal community pathways, with elevated symptoms of anxiety, depression, conduct problems, or post-traumatic stress. This study will test the effectiveness of FIRST compared to usual care on mental health outcomes, examine whether those outcomes are mediated by regulation of negative emotions, and explore clinician factors that may be associated with FIRST implementation and outcomes. Session recordings are coded to assess treatment fidelity. DISCUSSION: This study will evaluate the effectiveness of FIRST in youth community mental health settings, relative to the care usually provided in those settings. If FIRST is found to be effective, it could offer an efficient and practical method to increase use of empirically supported treatment principles in real-world practice contexts. TRIAL REGISTRATION: NIH Clinical Trials Registry, NCT04725721. Registered 27 January 2021, https://clinicaltrials.gov/ct2/show/study/NCT04725721.

Principle-Guided Psychotherapy for Children and Adolescents (FIRST): Study Protocol for a Randomized Controlled Effectiveness Trial in Outpatient Clinics.

Background: Hundreds of youth psychotherapy randomized trials have generated scores of helpful empirically supported treatments (ESTs). However, the standardized structure of many ESTs and their focus on a single disorder or homogeneous cluster of problems may not be ideal for clinically referred youths who have comorbidity and whose treatment needs may shift from week to week. This concern has prompted development of flexible transdiagnostic, modular youth psychotherapies. One of these, designed for efficient training and implementation, is FIRST-a transdiagnostic intervention built on five empirically supported principles of change (i.e., feeling calm, increasing motivation, repairing thoughts, solving problems, and trying the opposite) and targeting common internalizing and externalizing youth mental health disorders and problems. FIRST has shown promise in improving youth mental health in three open trials. Now, in a more rigorous test, we seek to (1) conduct a randomized controlled trial comparing FIRST to usual care in real-world clinical practice settings; (2) examine a promising candidate mediator of change-regulation of negative emotions; and (3) explore variables that may influence clinicians' treatment implementation. Methods: This is an assessor-naïve randomized controlled effectiveness trial in youth outpatient community clinics in New England and Texas. Using double randomization, clinic-employed clinicians and treatment-referred youths (7-15 years old) are independently randomly allocated (1:1) to FIRST or usual care. We aim to recruit 212 youth participants, all referred through normal community pathways, with elevated symptoms of anxiety, depression, conduct problems, or post-traumatic stress. This study will test the effectiveness of FIRST compared to usual care on mental health outcomes, examine whether those outcomes are mediated by regulation of negative emotions, and explore clinician factors that may be associated with FIRST implementation and outcomes. Session recordings are coded to assess treatment fidelity. Discussion: This study will evaluate the effectiveness of FIRST in youth community mental health settings, relative to the care usually provided in those settings. If FIRST is found to be effective, it could offer an efficient and practical method to increase use of empirically supported treatment principles in real-world practice contexts. Trial registration: NIH Clinical Trials Registry, NCT04725721. Registered 27 January 2021, https://clinicaltrials.gov/ct2/show/study/NCT04725721.

A Structural Model of Organization and Clinician Factors Associated with Standardized Measure Use in a National Survey of Youth Mental Health Providers.

Standardized assessment measures are important for accurate diagnosis of mental health problems and for treatment planning and evaluation. However, little is known about youth mental health providers' typical use of standardized measures across disciplines and outside the context of evidence-based practice initiatives. A multidisciplinary national survey examined the frequency with which 674 youth mental health providers administer standardized and unstandardized measures, and the extent to which organizational (i.e., implementation climate, rigid hierarchical organizational structure) and provider (i.e., attitudes toward standardized assessment measures, highest degree, practice setting) characteristics are associated with standardized measure use. Providers used unstandardized measures far more frequently than standardized measures. Providers' perceptions (a) that standardized measures are practical or feasible, (b) that their organization supports and values evidence-based practices, and (c) that their organization has a rigid hierarchical structure predicted greater use of standardized measures. Working in schools predicted less frequent SMU, while working in higher education and other professional settings predicted more frequent SMU. Standardized measures were not routinely used in this community-based sample. A rigid hierarchical organizational structure may be conducive to more frequent administration of standardized measures, but it is unclear whether such providers actually utilize these measures for clinical decision-making. Alternative strategies to promote standardized measure use may include promoting organizational cultures that value empirical data and encouraging use of standardized measures and training providers to use pragmatic standardized measures for clinical decision making.

Characterizing supervision-as-usual: Findings from two provider surveys.

Although clinical supervision is widely seen as critical for professional training and for safeguarding and promoting client well-being in mental health care, it is understudied, particularly in publicly funded services. In surveys of two large samples of youth mental health service providers (a state sample of providers billing Medicaid [N = 1,057] and a national sample of professional guild members [N = 1,720]), we examined the amount of time providers reported spending in supervision and consultation in a typical workweek and its covariation with characteristics of providers' caseloads and work settings. Across both samples, providers reported spending an average of 2-3 hr per week in supervision. Serving higher percentages of low-income clients was associated with significantly more supervision time. Working in private practice was associated with less supervision, while community mental health and residential facilities were each associated with more supervision time. The national survey also measured providers' perceptions of their current supervision. On average, providers endorsed feeling comfortable with the amount of supervision received and supported by their supervisors. However, working with more low-income clients was associated with greater need for supervisor approval and oversight and with less comfort in the amount of supervision received. Those working with more low-income clientele may benefit from additional supervision time or more focused supervision coverage of the specific needs of clients with low-income. More in-depth research on critical processes and content in supervision is a much-needed future direction for supervision research. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Measuring Evidence-Based Treatment Strategies in Youth Community Mental Health Care: the Evidence-Based Strategies Scale.

While there are established measures for fidelity to specific evidence-based treatments, there is no widely accepted, feasible measure of the use of evidence-based treatment strategies in youth mental health (MH) care. This study examined the factor structure of a provider self-report measure of evidence-based treatment strategy use, the Evidence-Based Strategies Scale (EBSS). MH providers completed the EBSS as part of a larger mailed survey. The factor structure of the EBSS was examined using exploratory factor analysis in a national, multidisciplinary sample of MH providers (N = 1092), and confirmatory factor analysis was subsequently conducted to replicate this factor structure in a state-wide, multidisciplinary sample of Medicaid MH providers (N = 780). Findings indicated a three-factor structure, representing working alliance, youth-focused, and family-focused evidence-based treatment strategies factors. The EBSS offers a potential method for measuring the evidence-based treatment strategies being delivered in youth community MH care, though more research is needed.

Assessing provider perceptions of training: Initial evaluation of the Acceptability, Feasibility, and Appropriateness Scale.

There is a well-documented gap between research and practice in the treatment of mental health problems. One promising approach to bridging this gap is training community-based providers in evidence-based practices (EBPs). However, a paucity of valid, reliable measures to assess a range of outcomes of such trainings impedes our ability to evaluate and improve training toward this end. The current study examined the factor structure of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a provider-report measure that assesses three perceptual implementation outcomes of trainings that may be leading indicators of training success (i.e., acceptability, feasibility, and appropriateness). Providers who attended half-day EBP trainings for common mental health problems reported on the acceptability, feasibility, and appropriateness of these trainings using the AFAS (N = 298). Confirmatory factor analysis indicates good fit to the hypothesized three-factor structure (RMSEA = .058, CFI = .990, TLI = .987). Acceptability, feasibility, and appropriateness were three distinct but related constructs. Cronbach's alpha ranged from .86 to .91, indicating acceptable internal consistency for the three subscales. Acceptability and feasibility, but not appropriateness, scores varied between workshops, though variability across workshops was generally limited. This initial evaluation of the AFAS is in line with recent efforts to enhance psychometric reporting practices for implementation outcome measures and provides future directions for further development and refinement of the AFAS. Plain Language Summary: Clinician training in evidence-based practices is often used to increase implementation of evidence-based practices in mental health service settings. However, one barrier to evaluating the success of clinician trainings is the lack of measures that reliably and accurately assess clinician training outcomes. This study was the initial evaluation of the Acceptability, Feasibility, Appropriateness Scale (AFAS), a measure that assesses the immediate outcomes of clinician trainings. This study found some evidence supporting the AFAS reliability and its three subscales. With additional item refinement and psychometric testing, the AFAS could become a useful measure of a training's immediate impact on providers.

Role-Play Assessment of Therapist Adherence and Skill in Implementation of Trauma-Focused Cognitive-Behavioral Therapy.

Numerous efforts are underway to train clinicians in evidence-based practices. Unfortunately, the field has few practical measures of therapist adherence and skill with which to judge the success of these training and implementation efforts. One possible assessment method is using behavioral rehearsal, or role-play, as an analogue for therapist in-session behavior. The current study describes aspects of reliability, validity and utility of a behavioral role-play assessment developed to evaluate therapist adherence and skill in implementing Trauma-Focused Cognitive-Behavioral Therapy (TF-CBT). TF-CBT role-play assessments were conducted with a sample of 43 therapists as part of a larger training study. The TF-CBT role-play assessments were independently coded for TF-CBT adherence and skill by a certified TF-CBT trainer and three clinical psychology doctoral students. Findings indicated good interrater reliability for the individual items (ICC: M = .71, SD = .15). Regarding utility, 67.19% (n = 43/64) of contacted therapists completed the role-play assessment, which took an average of 30 min (M = 31.42, SD = 5.65) to complete and 60 min (M = 62.84, SD = 11.31) to code. Therapists with a master's degree were more likely to complete the role-play assessment than those with other degrees but no other differences in demographic variables, practice characteristics, or TF-CBT knowledge or training were found between participants and nonparticipants. Role-play assessments may offer an alternative to observational coding for assessing therapist adherence and skill, particularly in contexts where session recordings are not feasible.

A Second and Third Look at FIRST: Testing Adaptations of A Principle-Guided Youth Psychotherapy.

Objective: We examined the acceptability, integrity, and symptom trajectories associated with FIRST, a principle-guided treatment for youth internalizing and externalizing problems designed to support efficient uptake and implementation.Method: We conducted two open trials of an adapted FIRST, focusing on uptake and implementation by novice trainees in a university-affiliated clinic, limiting treatment duration to six sessions, and benchmarking findings against a 2017 FIRST trial with community therapists. In Study 1, trainees received a two-day training and weekly two-hour supervision (N = 22 youths, ages 7-17, 50% female, 54.54% Caucasian, 4.55% Latinx). In Study 2, trainees received a one-day training and weekly one-hour supervision, delivering the six-session FIRST in a predetermined sequence (N = 26 youths, ages 11-17, 42.31% female, 65.38% Caucasian, 7.69% Latinx). In Study 3, the original study therapists - now practitioners - evaluated FIRST's effectiveness and implementation difficulty, and reported their own post-study FIRST use.Results: Acceptability (treatment completion, session attendance, caregiver participation) and integrity (adherence, competence) were comparable across Study 1, Study 2 and the 2017 trial. Improvement effect sizes across ten outcome measures were in the large range in all three trials: M ES = 1.10 in the 2017 trial, 0.83 in Study 1, and 0.81 in Study 2. Study 3 showed high effectiveness ratings, low difficulty ratings, and continued use of FIRST by a majority of clinicians.Conclusions: Across two open trials and a follow-up survey, FIRST showed evidence of acceptability and integrity, with youth symptom reduction comparable to that in prior research.

Evidence-Based Assessment in Routine Mental Health Services for Youths.

OBJECTIVE: Evidence-based assessment (EBA) plays a critical role in the delivery of effective treatments. However, little is known about the assessment practices of mental health clinicians who treat youths and the factors that support EBA. The authors examined when, how, and under what conditions clinicians conduct EBA. METHODS: In two multidisciplinary surveys (combined N=2,575), clinicians reported how frequently they conducted pretreatment, ongoing, and posttreatment assessments and how frequently they used standardized measures in usual care of youths. RESULTS: Although clinicians reported frequent pretreatment, ongoing, and posttreatment assessments, use of standardized measures was rare. Clinician and practice setting characteristics predicted standardized measure use, and a lack of practical assessment tools appears to be a barrier to use of standardized measures in EBA of youths. CONCLUSIONS: Many clinicians conduct assessments during treatment, but more practical measures and clinician training may improve the integration of standardized measures into routine practice.

Increasing Access to Psychiatric Services in Schools: The Bridge Program.

One in 5 youth experience a psychiatric disorder in any given year, but fewer than half of these youth receive mental health services. This lack of service utilization is often attributed to structural and perceptual barriers, and school-based mental health programs have been proposed as a means of addressing these barriers and increasing youths' access to services. While universal prevention programs and targeted treatments may benefit most youth receiving services in schools, collaborations between schools and child psychiatry may benefit youth with the most severe symptoms and the greatest impairment. This article describes the Bridge Program, a school-based psychiatric program funded by a county-wide mental health tax initiative designed to provide psychiatric services in local schools without any out-of-pocket expenses for youth and families within 10 days of referral. Two case reports provide a description of the delivery of psychiatric services through the Bridge Program. Future research is needed to compare the feasibility and effectiveness of different approaches to increasing access to youth psychiatric care.

Evidence-Based Treatment Strategies in Youth Mental Health Services: Results from a National Survey of Providers.

Previous surveys indicate infrequent use of evidence-based treatment (EBT) manuals in usual care youth mental health, but the extent to which providers use core and common EBT strategies and what contextual factors impact EBT strategy implementation need further study. In a national, multidisciplinary survey of 1092 youth-serving providers, providers reported regular use of many EBT strategies. Provider learning theory orientation, more recent degree, more standardized and ongoing assessment use, more positive attitudes toward innovation and evidence, fewer low-income clients, and perceptions that their agency valued quality care and provided fewer training resources predicted more frequent EBT strategy use.

Reflective functioning in parents of school-aged children.

Parental reflective functioning (RF) has garnered tremendous support as a predictor of secure attachment in infancy, though little work has examined RF among parents of older children. In this study, we used a high-risk community sample of parent-child dyads (N = 117) to explore whether parental RF comprises self- and child-focused factors, whether parental RF is associated with parent and child attachment security, and whether parental RF mediates the association between parent and child attachment security. Results suggested that parental RF can be characterized as having both self- and child-focused components, and that child-focused parental RF is associated with child but not parent attachment security. Further, child-focused parental RF indirectly mediates the association between parent attachment avoidance and child attachment security. These findings extend previous work on parental RF to parents of school-age children and, in so doing, inform developmental models of attachment relationships in middle childhood. Discussion focuses on the importance of these findings in informing theory, prevention, clinical practice, and policy.